Entropic information— disturbance tradeoff 
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We show the flaws found in the customary fidehty-based deflnitions of disturbance in quantum 
measurements and evolutions. We introduce the "entropic disturbance" D and show that it ad- 
equately measures the degree of disturbance, intended essentially as an irreversible change in the 
state of the system. We also find that it complies with an information-disturbance tradeoff, namely 
the mutual information between the eigenvalues of the initial state and the measurement results is 
less than or equal to D. 
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The correct interpretation of the Heisenberg uncer- 
tainty relations [ilQl connects the uncertainty (or spread) 
in the measurement results of one observable to the 
spread of another observable in the initial state of the 
system |3|. The true spirit of Heisenberg's intuition P,I3, 
however, was that any measurement (i.e. extraction of 
classical information from a quantum system) necessarily 
entails some kind of disturbance to the measured system. 
This intuition has yet to be captured in a truly general 
information-disturbance tradeoff relation. Nonetheless, 
several of these relations have been put forth and cover 
many conceivable situations (e.g. see 0,01 BQ)- The 
main problem in deriving a general version of such a 
tradeoff lies in the identification of an appropriate def- 
inition for the disturbance. 



In this paper we explore the consequences of defin- 
ing the disturbance as an irreversible change in the state 
of the system. We proceed axiomatically, by enumerat- 
ing the abstract properties that a disturbance measure 
should possess, and we show that the customarily used 
fidelity-based disturbance measures do not satisfy them. 
We introduce one that does, namely the "entropic dis- 
turbance" D. A simple, general information-disturbance 
tradeoff is then derived, namely I ^ D {I being the mu- 
tual information between the eigenvalues of the initial 
state and the measurement results). Its interpretation is 
straightforward: Every time an amount / of information 
is obtained from the measurement apparatus, a distur- 
bance D at least as big is introduced on the system, but, 
obviously, the system can be disturbed by a process that 
returns little information. We also derive the equality 
conditions I = D showing that the I ^ D bound is tight, 
and proving (as is to be expected 'S]) that von Neumann- 
type measurements are among the least disturbing amid 
all measurements that retrieve the same information. Fi- 
nally, we give a state-independent tradeoff by averaging 
over all possible input states. This provides a measure 
of the global disturbance introduced by the apparatus or 
by a generic evolution. 



I. MEASUREMENT 

A measurement is by definition an operation that acts 
on a system and returns some classical information, i.e. 
a label "/fc" identified by an index k. This operation 
typically, but not always, changes the state of the mea- 
sured system {wave-function collapse mechanism). When 
measuring classical objects, the state change is only due 
to the change in the information we have on the sys- 
tem: The uncertainty in the state is usually reduced. 
When measuring quantum objects, the state change can 
have a dynamical nature that perturbs the system. The 
rigorous description of these mechanisms results from 
the Kraus decomposition of the measurement appara- 
tus lalSl) which identifies the completely positive (CP) 
map of its evolution. When the system is initially in 
a state p, the kth measurement outcome occurs with a 
probability pk =Tr[nfep], where {11^} is the apparatus 
POVM (Positive Operator- Valued Measure), a set of pos- 
itive operators normalized so that J^k ^k = 1- After the 
outcome Ik is obtained, the state is changed to 



o\k) = J2KrpK,ypk 



(1) 



ie/fc 



where Ik is a set of indices i and Ki are the apparatus 
Kraus operators. The POVM in terms of these is given 
by Hk = X^ie/ Ki'Ki. On the basis of the above de- 
scription of the measurement, we can define the following 
information and disturbance measures. 

Information: The outcome Ik provides the experi- 
menter with some information /. We are, obviously, in- 
terested in the case in which Ik provides some information 
on the measured system, and it is not just independently 
generated by the apparatus. Thus, a good measure for / 
is the mutual information between the measurement re- 
sults and some property of the system state. A significant 
(basis-independent) property is the spectrum of the state 
p, i.e. the probability distribution of its eigenvalues Xj. 
Of course, the ensemble composed by the eigenvectors of 
p weighted by the corresponding eigenvalues is not the 
only one that originates from the state p. However, it is 
easy to see that it is the one that allows to recover the 
maximal accessible information (it saturates the Holevo 



bound) [13 • It is thus the appropriate choice since we 
ultimately want to bound the information from above. 
We then use 



/ = I{Xj,Pk) , 



(2) 



the mutual information between the label j identifying 
the eigenvalue of p and the label k identifying the mea- 
surement result: / is the number of bits that the experi- 
menter gains from the result Ik on which eigenvector of p 
the system was in (before the measurement). It is max- 
imal when all eigenvalues are equal (the experimenter 
has no prior info on the state), and it is null when the 
state is pure (the experimenter already has total knowl- 
edge of the state, and cannot gain any more information 
on it). [Note that p here refers to the state from the 
experimenter's point of view: It reflects his prior knowl- 
edge of the system state, i.e. that each eigenvector has 
a prior probability Xj. The 'true' state (i.e. from the 
point of view of who is preparing the system) will be in 
general purer. The knowledge that can be acquired by 
the experimenter is upper bounded by the difference in 
entropy between these two representations of the state.] 
If the Hilbert space of the system has finite dimension 
d, we can normalize / by dividing it with its maximum 
value log2 d, so to have ^ / < 1. 

Disturbance: A disturbance is an irreversible change 
in the state of the system, caused by a CP-map evolu- 
tion (such as the dynamical disturbance caused by quan- 
tum correlations that leak out to the environment and 
are lost). Thus, any quantity D that measures distur- 
bance should satisfy the following requirements, inspired 
by Ref. H: 

i) D should be a function only of the input state p 
and of the apparatus, identified through its Kraus 
operators {Ki}, i.e. D — D{p,{Ki}). 

a) D should be null if and only if the transformation 
{Ki} is invertible on p |22|. In this case the state 
change can be undone, and such transformation is 
not disturbing the system. 

Hi) Once the state has been disturbed, it should not be 
possible to decrease D with any successive transfor- 
mation. This means that D should be monotoni- 
cally non-decreasing for successive applications of 
CP-maps «| (i.e. it should satisfy a sort of pipeline 
inequality). This requirement captures the notion 
that a disturbance should be irreversible, and is 
connected with the concept of "cleanness" [ll|. 

iv) D should be continuous: Maps and input states 
which do not differ too much should give similar 
values of D. 

The above requirements, which define the disturbance 
axiomatically, have nothing to do with the information 
the measurement provides. As such, there is no obvious 
a priori reason why an information-disturbance tradeoff 
should hold. 



Definitions of disturbance are customarily based on the 
fidelity or the Bures distance |12| between input and out- 
put states. Even though valid information-disturbance 
relations can be found 5], these definitions do not seem 
to appropriately gauge the disturbance, intended as an 
irreversible evolution. In fact, even though a unitary 
transformation is perfectly reversible, it can rotate a 
state to an orthogonal configuration, generating the max- 
imum possible fidelity-based disturbance. These quanti- 
ties do not satisfy the requirements ii) and Hi). Analo- 
gous considerations apply also if we use the entanglement 
fidelity [l3| in place of the fidelity |23| • 

A definition of disturbance D that satisfies all the 
above requirements can be found by recalling that a 
CP-map Q is invertible if and only if [lj| the map's 
coherent information Ic{p, Q) is equal to the von Neu- 
mann entropy S{p) = — Trip lofo p] of the input state 
p. The coherent information |14L Il5l| is defined as Ic = 
S'(Q(p))- 5 ((Q(»l)(|*) (*!)), where |*) is a purifica- 
tion of p and the map Q (8) 1 acts with Q on the system 
space and with the identity 1 on the purification space. 
The quantity Ic is non-increasing for application of CP- 
maps (data- processing inequality) |14| . Namely, for any 
two maps Q and Q' , we have Ic{p, Q) ^ Ic{p, Q' ° Q), 
where o denotes composition of maps. Thus, a distur- 
bance measure that satisfies requirements ii)-iii) must 
be a function / of S{p) — Ic, with / non-decreasing and 
null when its argument is: /(O) = 0. We then define 

D = Sip) - Ic (3) 

= s{p)-siQip)) + s{{Q®t)mm), 

which, in addition to ii)-iii), also satisfies requirements i) 
and iv) since it is continuous (see the Appendix). Anal- 
ogously to I, also D can be normalized in d-dimensional 
Hilbert spaces by dividing it by log2 d, so that ^ D ^ 2. 
From the postulates of quantum mechanics it follows 
that the system state p describes the information the ex- 
perimenter possesses on the system. Hence, there are 
two mechanisms that lead to a state change: the sys- 
tem dynamics and the acquisition of new information. 
Heisenberg, in his uncertainty principle, was consider- 
ing the former mechanism only. To exemplify the latter, 
suppose I acquire a qubit in an unknown state. Initially, 
I will assign to it the state 1/2, but as soon as the pre- 
parer tells me that the qubit was in the state pp, from my 
point of view it undergoes a state change (even though 
I may have not interacted with it) described by the map 
Pp — C[t/2]. We can call this a "purely informational" 
state change. Since both the dynamical and the infor- 
mational state changes are described by CP-maps, they 
both fall in the general framework described above. [In 
this sense it may be interpreted as a generalization of 
Heisenberg's intuition]. Is it possible to weight the con- 
tribution of these two mechanisms in each measurement 
apparatus? Yes: Since the set of CP-maps is a convex set, 
the apparatus CP-map Q (identified by the Kraus opera- 
tors {Ki}) can always be written as a convex combination 
of the purely informational map C and of a "dynamical" 



map T as 



Q ^ ec + (1 - 0^ with e e [0, 1] 



(4) 



The Kraus operators of the map C are ^jfe = JJiLj\vj){vk\, 
where /j,j and \vj) are the eigenvalues and eigenvectors 
of the 'true' (i.e. from the point of view of the pre- 
parer) state pp-. The action of C must not change the true 
state, C[pp] = Pp. [Note that in the case of a degener- 
ate state Pp, the map C might not be univocaUy defined]. 
The POVM of a purely informational measurement is 
then lik = Y^j Ajk^Ajk = \vk){vk\ (the projectors on the 
eigenspaces of pp). In this respect, the truly quantum 
contribution to the disturbance in a measurement is re- 
lated to the map T: it is present in those measurement 
apparatuses with ^ < 1. 




Qfc[p]-Q' 



R' 



FIG. 1: Measurement apparatus described through the indi- 
rect measurement model. Any apparatus can be described |3] 
by coupling the system to be measured (in the space Q) with 
a probe P through a unitary operator U . The probe is then 
projectively measured at the output P'. Notation employed 
below: [0)p = initial state of the apparatus in P; p = ini- 
tial state of the system in Q; 'P[p\ = state of the probe in 
P', before the final projective measurement; Qk[p\ = state 
of the system in Q', after the interaction with the apparatus 
and after the probe measurement with result Ik (i.e. after 
the wave-function collapse). The reference R is introduced 
for purification purposes: It is defined so that the joint initial 
state I*) of system and reference, QR, is pure. 



II. INFORMATION-DISTURBANCE 
TRADEOFF 

We now prove the information-disturbance tradeoff 



I{X„Pk)i^D{p,{Ki\) 



(5) 



Any measurement apparatus can be decomposed into a 
unitary evolution U (the Stinespring dilation of the ap- 
paratus) followed by a von Neumann projective mea- 
surement on a probe P, the so-called indirect measure- 
ment model [3, see Fig. ^ The unitary U couples 
Q with the probe P in the apparatus yielding Q' and 
P'. The joint evolution of probe and system PQ in 
the apparatus can be seen as composed by two com- 
plementary quantum channels: A channel Q— >P' that 
describes the transfer of information from the system 
to the state of the probe in P' which is then mea- 
sured yielding the measurement result Ik, and a channel 



Q^-Q' that evolves the system before the measurement 
into the system after the measurement conditioned on 
its result Ik- These two channels are respectively de- 
scribed by the CP-maps V[p\ =Ttq[U{p ® |0)p(0 )W] 
and Qk[p\ =Ttp[U{p® |0)p(0|)C/t(lQ ® \k)p{k\)\/pk, 
where |0)p is the initial pure state of the probe, \k)p 
is the basis representing the projective measurement on 
the probe, and pk is the probability of the fcth result. 
Since the final state of the system in Q' is given by 
p' {k) = Qk[p] with probability pk, it can be written as 
EfePfep'(fc) =Trp[C/(p® |0)p(0|);7t] = Q[p\, where the 
Kraus operators of the map Q can be immediately ob- 
tained from the ones of the maps Qk- The map Q de- 
scribes the unitary coupling of system and probe in the 
apparatus and the successive trace on the probe space, 
which yields the unconditioned output state. 

The system's initial state p, expanded on its eigen- 
vectors |j) is given by p = 'Yj^j\j){j\- We use the 
Holevo-Schumacher- Westmoreland theorem [ig| with an 
alphabet composed by \j){j\ with probability \j flowing 
through a channel described by V . Such theorem im- 
plies that the mutual information I{\j,pk) between the 
variable j and the measurement results k (whatever mea- 
surement strategy is employed) is upper bounded as 



I{\,,Pk) ^ S{V[p]) -Y,\,S{V[\]){j\ 



(6) 



The system in space Q can be purified by adding an aux- 
iliary reference space R, so that the system in QR is ini- 
tially in a pure state |*). The entropy S{P') = S{V[p\) 
of the probe just before the final von Neumann measure- 
ment is then equal to the entropy S'(Q'R') of the joint 
state in Q'R' of the system and the reference after the 
interaction U . In fact, the initial state in PQR is pure and 
it is evolved into P'Q'R' by a unitary evolution. Thus, 

S{V[p])^S{Q!^)^S,{p,Q), (7) 

where Se{p, Q) is the exchange entropy M^i, ^^ of the 
map Q. It is defined as the entropy of the joint Q'R' 
output state of system and purification-reference, i.e. 
Se{p,Q.) = 5'((Qig)lp)[|*)(*|]). Moreover, the entropy 
in Q' satisfies 

5(Q') ^ S{Q[p\) (8) 

= s{Y.^,Q[\3)m)^Y.^,S{Q[\j){j\\)+H{\,), 

j 3 

where H{\j) = S{p) is the Shannon entropy of the 
probability distribution Aj, and where the inequality 
S{Y,^PxQx) ^ Y.xPx^iB'-c) + H{px) (valid f^ all prob- 
abilities Px and states p^) has been used [i3|. Notice 
that if the system in Q is initially in a pure state |j), 
the entropy of the output of the two channels V and Q 
coincides since the entropy of the joint system PQ is ini- 
tially null Hence, S{Q[\j){j\]) = S{V[\j){3\]), so that 
Eq. IjHJl imphes 



Y.^jS{V[\3){j\])^S{Q[p])~-S{p) 



(9) 



Joining Eqs. P, and ®, we find / < Se{p,Q.) - 
S{Q[p]) + S{p) = S{p) - Up, Q) = D, thus proving 
Eq. 13). Notice that such proof works also in the case 
in which the input and output Hilbert spaces Q and Q' 
do not coincide, and in the case of infinite dimensional 
Hilbert spaces |l7i |. 

There is a simple, not- very-rigorous, intuition behind 
the preceding proof. The total quantum information of 
the initial state p can be quantified by iV ~ S{p) qubits. 
The unitary evolution U transfers n of them to the probe 
space P, where the projective measurement can return a 
number of bits b ^ n, due to the Holevo bound jlj . The 
remaining N — n qubits constitute an upper bound to the 
quantum capacity to transfer the quantum information 
in the initial state through the channel Q^Q' consisting 
of the measurement apparatus. The quantum capacity 
is measured by the coherent information [ij, [13 , so that 
Ir€N~n. Thus, 



energy.] Thus, we can define a state-independent in- 
formation as I{pk) = I{^/d,pk) and a state-indepen- 
dent disturbance as D{{Ki]) = D{l/d, {Ki}) = log2 d — 
Ic{^/d,Q). The quantity //logjd measures the per- 
centage of the maximum retrievable information that is 
achieved by the apparatus. The quantity D measures 
the disturbance the apparatus causes to a completely 
unknown state. Notice that 13 = if and only if the 
apparatus acts on the state with a unitary transforma- 
tion (i.e. it yields no information on the state). In fact, 
S{p) — Icip, Q) if and only if the map Q is invertible 
on all the pure states in the support of p ,14] , which for 
p = H/d implies that the map is unitary. 



IV. CONCLUSIONS 



/~6s^n = iV-(iV-n)^Ar-/c 



D 



(10) 



We now deduce the equality conditions for the 
information-disturbance bound I ^ D, showing that it 
is achievable. The equality in the Holevo-Schumacher- 
Westmoreland relation of Eq. dpi) is achieved if the alpha- 
bet states P[|i)(j|] commute [l^. Moreover, the equal- 
ity in the relation Si^^p^Qx) ^ Y^xP^^ie^) + H[px)j 
which was employed in Eq. (jS)) , is achieved if and only if 
the states px have support on orthogonal subspaces | l2| 
(which implies that they commute). Thus, we have equal- 
ity /= 13 if and only if the channel V maps differ- 
ent eigenvectors |j) of the initial state p into orthogonal 
subspaces. A typical example is a projective measure- 
ment whose Kraus operators are projectors on the basis 
|j). It is a purely informational measurement, where the 
only uncertainty derives from classical probability. [No- 
tice that, in a d-dimensional Hilbert space, the converse 
also holds for measurements with d outcomes: li I — D 
and the measurement POVM has d elements, then the 
measurement is a von Neumann-type projection, i.e. its 
Kraus operators are of the form Aj — U\aj){aj\ where 
[/ is a fixed unitary and \aj) is a basis. The proof of 
this assertion follows immediately from the fact that the 
measurement must map a basis \j) of d elements into d 
orthogonal subspaces, which, in a d-dimensional Hilbert 
space, must then be one-dimensional]. 



We have introduced a new measure D{p, {Ki}) of the 
disturbance (intended as an irreversible state change) 
that a map with Kraus operators {Ki\ induces on a 
system in a state p. We have derived an information- 
disturbance tradeoff for such a quantity in the form 
I ^ D, where / is the classical info the map {Ki} re- 
turns on the state p to the experimenter. The equality 
conditions for this bound have been^alsq^derived. More- 
over, a state-independent tradeoff I ^ D was obtained, 
which bounds the percentage of the maximum achiev- 
able information / with the disturbance D caused to a 
completely unknown input state. 

Even though we found a valid information-disturbance 
tradeoff, we have to conclude that the disturbance defi- 
nition D we used here may not be the appropriate defi- 
nition to capture the true spirit of Heisenberg's intuition 
(the "uncertainty principle"). In fact, a "classical" mea- 
surement (or a purely informational state change) where 
one gains information on which, out of a set of orthogonal 
configurations, our state is in, will perturb the state in an 
irreversible manner even though there is no dynamical in- 
teraction on the system. Heisenberg, on the other hand, 
analyzed only the irreversible state changes induced by 
dynamical actions (measurements) on the system. In this 
sense, the information-disturbance relation derived here 
might be considered as an extension of Heisenberg's in- 
tuition on the disturbance a measurement induces. 



III. STATE-INDEPENDENT TRADEOFF 



The definitions we used for information I(Xj,pk) and 
disturbance D{p, {Ki}) are explicitly dependent both on 
the input state p and on the apparatus. We can forgo the 
state dependence by averaging on all possible input states 
with equal weights (for symmetry reasons), i.e. by using 
a state p = TL/d in a d-dimensional Hilbert space. [In 
infinite-dimensional spaces, additional requirements are 
also necessary, such as using states with upper-bounded 



APPENDIX A: CONTINUITY OF D 

Here we prove that the entropic disturbance D is con- 
tinuous. More rigorously, we prove the following two 
statements: i) p ^ p' , i.e. T(p,p') —^ 0, implies 
D{p, Q) -^ D{p' ,Q), where the trace distance T is de- 
fined as T{p,p') =Tr[|p - p'|]/2; n) Q -> Q' , i.e. 
TiQ[p], Q'[p]) -> 0, implies D{p, Q) ^ Dip, Q'). 



Proof of i): Start from 

D{p, Q) - D{p', Q) = [S{p) - S{p')] (Al) 

-[S{Q{p)) ~ S{Q{p'))] + [S,{p, Q) SAp', Q)] ■ 

The first bracket in Eq. (|A1(I tends to zero for p ^ p' 
thanks to the continuity of the entropy. It derives 
from Fannes' inequahty 2C||, according to which \S{p) — 
S{p')\ ^ h{T{p,p')) with the function h{x) ^ for a; ^ 
0. The second bracket in Eq. (|A1() analogously goes to 
zero since it is bounded by the first: The contractivity of 
CP-maps '21'! implies that T{Q{p), Q{p')) ^ T{p,p'). To 
show that also the last bracket tends to zero, recall that 
the exchange entropy can be written as S'e(p, Q) = S{W) 
with the matrix W defined by W^j =Ty[K,pK]], Ki be- 
ing the Kraus operators of Q [l3l|. Thus, Fannes' inequal- 



ity implies |S'e(/0, Q) 
p — > p', we have W - 



' Seip', Q)\ < h{TiW, W')), and for 
W'. In fact, since W is Hermitian, 



m, - W[\^ = Tr[A\Mp - p')]Tv[A\A, {p p')] 



< Tr[A]A,A\AjXlT[{p-p' 



(A2) 



where we used the Schwarz inequality for the Hilbert- 
Schmidt scalar product of operators: {A\B) =Tt[A'^ B]. 

Proof of ii): it follows immediately from the continuity 
of the entropy, i.e. from the Fannes inequality [2u\. 
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